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ABSTRACT 

Africa (Unisa) library is integrated in its planning and review 
procedures and is continuously adapted and improved* This paper 
traces the development of performance measurement at Unisa over more 
than a decade* Performance measurement provides an indication of how 
good or bad the library is doing in relation to its goals and 
objectives and highlights problem areas to be addressed. Advantages 
of performance measurement at Unisa include the six-monthly planning 
cycle, which encourages the staff to focus on key performance areas; 
and the gradual development of the system, which has resulted in 
general agreement on all the objectives. Disadvantages to performance 
measurement include its time consuming nature; and the focus on the 
core business of the library and resultant overemphasis on 
operational goals. A recent strategic planning initiative and library 
restructuring resulted in a new performance review and planning 
approach with a more client oriented focus. Performance measures must 
be operationally significant, simple, meaningful, and must try to 
measure only things that are measurable. Performance measurement at 
Unisa has proven its value in the planning process and has assisted 
in improving and maintaining library service levels. The time and 
resources devoted to performance measure are regarded as an essential 
investment. Appendices include: library goals, objectives, standards, 
and achievements over time; reasons for performance failure (1994); 
interlending performance measurement and objectives (1990-1994); 
performance review and management planning report for the Document 
Delivery Division (August 1995); and performance indicators for the 
library and its individual divisions. A brief discussion with the 
author is provided. (SWC) 
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Introduction 

W ith the exception of a number of projects 

which have been undertaken as pure research, 
performance measurement in libraries is usually 
done for one of two reasons. The first is that it is 
required by the library’s governing body, which 
wants some form of accountability, usually from a 
financial perspective. In this case the measures are 
usually determined by outside persons, and very 
often without consultation of library staff. As a 
result library staff react negatively to performance 
measurement of this nature, predominantly because 
they regard the measures as inappropriate. 

The second reason to measure the performance of 
a library is the library staff’s own wish to know how 
well they are doing, to determine which areas of the 
library services need to be improved or to convince 
their authorities of their library’s need for financial 
support (Willemse, 1989). The approach taken by 
libraries depends on their perception of organisa- 
tional effectiveness. The complexities of organisa- 
tional effectiveness and the widely divergent views 
that exist are clearly summarised in one of the most 
recent publications on the topic (McDonald, 1994). 
In the case of the University of South Africa 
(Unisa) the library has for many years expressed 
that its aim was to provide the best possible library 
service, and in fact that it wanted to be the best 
library. Although the library had been continuously 
improving its services, it had never measured its 
performance in any meaningful way. When lecturers 
from the University’s Post-graduate School of 
Business Leadership (SBL) acted as consultants for 
the library in its endeavour to further improve its 
services in the late Seventies, the first question they 
asked was how we would know when we were the 
best. The ensuing discussion led to a realisation of 
the need for a process of setting clear goals and 
objectives for effective service from the user’s point 
of view. This paper will describe the development 
of the use of performance measurement at Unisa as 
part of the library’s integrated planning and control 
process in its continuing effort to improve its ser- 
vices over more than a decade. It is, therefore, a 
discussion of the application of performance mea- 



surement in the management of a library and will 
not be concerned so much with the actual perfor- 
mance measurement itself. 

University of South Africa 

T he following background information on the 
University and its library will help to better 
understand the discussion of the process which is to 
follow. Unisa, which started as the University of the 
Cape of Good Hope in 1873, being the administra- 
tive mother institution for a number of university 
colleges, assumed a distance teaching function in 
1947, when most colleges had become or were on 
the verge of becoming autonomous universities. 
Unisa was, therefore, one of the first universities to 
be devoted entirely to distance teaching. It is at pre- 
sent offering undergraduate as well as postgraduate 
studies up to doctoral level to over 128,000 stu- 
dents, mostly in Southern Africa. The Unisa 
Library, in contrast to those at most other distance 
teaching institutions, offers a full service to both 
staff and students. With almost 1.6 million volumes 
of books and journals and 7,000 current periodicals 
as well as a large collection of audio-visual materi- 
als, mainly in the humanities and social sciences, it 
is one of the largest research libraries in the country. 

The library service to undergraduate students 
focuses primarily on the provision of literature rec- 
ommended for assignments which students have to 
do in most courses. This service is provided by way 
of a separate Study Collection with multiple copies 
of the recommended titles in the main library in 
Pretoria as well as in branches in some of the 
larger urban areas. A large part of the circulation is 
done by post (Willemse, 1991). 

The service to the teaching staff, researchers and 
postgraduate students is developed around a large 
number of subject librarians who, apart from being 
responsible for the development of the Collection, 
assist the researchers with literature surveys and 
obtaining literature not available in the library. For 
this purpose an excellent collection of bibliographi- 
cal reference sources has been developed, which is 
supplemented by the latest CD-ROM and online 
information services available. 
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Start of Unisa Performance 
Measurement 

T he continuing average 9 % per annum increase 
in the number of students during the Sixties and 
Seventies resulted in a strong growth in library col- 
lections and staff. This required that the organisa- 
tional structure of the library be adapted from time 
to time to the changing circumstances. Lecturers 
from the SBL, who had been applying an integrated 
planning, control and performance evaluation sys- 
tem in the business sector, were keen to test this in a 
service environment and offered to assist the library 
in putting it into practice. Their system was basical- 
ly a bottom to top approach, where in each section 
the staff with their supervisor and his/her immediate 
superior had to decide on those key performance 
areas which would most contribute to the success of 
the organisation. Agreement had then to be reached 
on measures which could be used to determine the 
level of performance. Each supervisor then had to 
report regularly to his/her superior on progress and 
planning for further improvement. Although this 
exercise was a big success from the point of view of 
determining exactly what supervisors required from 
their staff, many problems were encountered in 
finding acceptable measures for performance. The 
main reason for this was the staff’s unfamiliarity 
with sampling techniques and their resultant mis- 
trust of the findings. Our efforts to pressurise staff 
to accept measures for activities resulted in endless 
debates, as it was often felt that one measure that 
was decided upon did not measure the value of that 
activity adequately. The negative reaction which 
developed was so strong that the whole exercise had 
to be stopped. 

On the positive side there was general agreement 
amongst the staff that the library did require a well 
formulated goal with measurable objectives which 
would indicate to what extent the library and its 
divisions were performing well. The SBL team’s 
argument that an activity or programme had to make 
a measurable contribution to the realisation of the 
organisation’s goal made sense, as each activity was 
using up a part of the available resources. From a 
management point of view it is, therefore, essential 
to determine to what extent these resources are 
being applied to realise the objective for which they 
were provided. It is also essential that the perfor- 
mance be continuously evaluated. 

The ideal to make our library the best can possi- 
bly be regarded as vague, naive or even unrealistic. 
It was, however, very seriously intended. The senior 
^ taff of the library came to the conclusion that the 



best approach was to formulate a goal which took 
into account the reasons why the authorities were 
providing extensive funds for the library service, 
that is, as the most cost-effective means to provide 
staff and students with access to the publications 
and other information sources which they need as 
well as information which they may require. The 
goal also had to be in line with the reasonable 
expectations of users of the service. Objectives to 
realise that goal had then to be formulated in quan- 
tifiable terms, after which measures had to be found 
by which library management, university authorities 
and users could see to what extent the library was 
realising its goal. It should be stressed that Unisa’s 
decision in this regard was based on the library 
management’s ideal to develop an excellent service. 
At the start of the project little had been published 
on this topic in the library literature and the library, 
therefore, tackled the problem largely on an empiri- 
cal basis (Willemse, 1987). 

Mission, Goals and Objectives 

W here the SBL had followed a bottom to top 
approach, it was now decided to follow a top 
to bottom one, starting with the formulation of the 
mission and organisational goals for the library by 
the Chief Director and the five heads of divisions. 
After they had reached agreement amongst them- 
selves, the statements were discussed and further 
refined by a committee of staff from the middle 
management levels and eventually approved by 
the Library Committee. It was a slow process but 
the many discussions over a long period of almost 
two years had the result that it was widely accepted. 
The cornerstones of the mission statement were (1) 
the need actively to promote rather than just to sup- 
port the university’s programmes; (2) a clear dis- 
tinction between the different needs of the two 
main user groups, namely undergraduate students 
on the one hand and lecturers and researchers 
(including postgraduate students) on the other; and 
(3) the view that the primary services to be provided 
were information sources and information itself. 

The need for community service was also realised, 
including the need for library co-operation. With 
time it was further realised that the library also had 
an obligation to educate its clientele in the effective 
use of library and information resources. 

Although it had been agreed from the start that 
the main thrust would be on effectiveness, it was 
realised that efficiency was no less important and 
had also to be addressed. The summary of the 
library’s mission, goals, objectives and measures as 
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it appears in Appendix 1 provides the situation as it 
has developed over time. It was agreed by the 
library staff that we had, in common with most ser- 
vice organisations, a large number of goals, but 
decided that we had to concentrate on a few of the 
most important ones. 

Information Provision 

T he goal to provide information, or access to it, 
is perhaps the ultimate goal of any library. Due 
to the nature of Unisa’s distance teaching function 
undergraduates have requested virtually no informa- 
tion services from the library in the past and goals 
or objectives were, therefore, only set for the provi- 
sion of information for research addressing the 
needs of 3,000 students and the 1,400 academic 
staff. Their requirements are predominantly in 
respect of literature surveys for their research, 
which were addressed in the goals statement. 

The objective to answer, upon request, the great- 
est possible percentage of bibliographic and infor- 
mation enquiries accurately and quickly has for 
many years posed a problem, as no acceptable mea- 
sure to determine its effectiveness could be found. 
Most of the methodologies proposed in the literature 
were either not applicable to our situation or too 
time-consuming and costly to be used on an annual 
basis or more. A number of measures were tried and 
later discarded. Eventually a member of staff did a 
Masters thesis in library science on the topic 
(Dalton, 1991). Her study developed a quantitative 
user satisfaction assessment instrument for imple- 
mentation as a management tool to evaluate user 
satisfaction levels with the quality of the service 
provided by the Subject Reference Division. A user 
satisfaction model, derived from the disconfirma- 
tion of expectations paradigm applied in consumer 
satisfaction research, which defines satisfaction as 
the difference between the average actual perfor- 
mance of the service provided and the average 
expectations of the user, was used. Having derived 
statistically-based quantitative levels of satisfaction 
for the different components of the subject reference 
service, a user satisfaction scale is proposed to regu- 
larly monitor user attitudes. Her findings provided 
an excellent basis for evaluating user satisfaction 
with the service of the subject librarians in general. 
They did, however, not provide an insight into the 
effectiveness of the information service and any 
specific problem areas. 

The provision of information sources was seen as 
the primary function of the library. Most of its 
human and financial resources were, and are still 



used for that purpose. The next step was the formu- 
lation of the library’s document or information 
source delivery goal in terms of effectiveness from 
the user’s point of view. It was argued that users 
would perceive the service as effective to the extent 
that they would be able to obtain the required infor- 
mation sources. Separate goals for students and 
researchers, who had different needs, were decided 
upon. The initial objective was formulated as an 
ideal availability rate of 90%. This rate was decid- 
edly unrealistic in view of the prevailing situation. 

As such an unrealistic objective has a negative or 
demotivating influence on the library staff, the long- 
term objective for effective provision of information 
sources was reformulated so as to provide the maxi- 
mum quantity of required information sources upon 
request. The present situation serves as a point of 
departure and at each planning session an objective 
for a realistic improvement of performance has to 
be set. 

Availability Performance 

he first measurement of the effectiveness of 
document delivery was based on available data. 
This, however, proved to be too imprecise as it did 
not fully reflect failures of local users. At that time a 
methodology reported by the Library Management 
Research Unit in Britain was identified which, with 
a number of changes for our specific circumstances, 
has been the survey method used, according to 
which availability has been determined since 1985. 
Later further refinements were made, based on 
Kantor’s methodology. In the beginning the surveys 
were done on a monthly basis, but this was rather 
costly and had to be reduced to quarterly ones. 

From the figures in Appendix 1, one can see a fluc- 
tuating, though in most cases slowly, improving per- 
formance. Although the improvements are not dra- 
matic, it needs to be pointed out that during this 
period the book and journal budgets were under 
serious pressure and book acquisitions are at present 
below the level of 1982 whilst student figures have 
increased two-and-a-half times. The improved per- 
formance has to be attributed to the information 
resulting from our continuous performance mea- 
surement and the focused planning efforts to ensure 
greater effectiveness. 

The information from the availability surveys, 
which are also designed to establish reasons for fail- 
ure, have produced information which has in partic- 
ular facilitated a continuous process to eliminate or 
rectify problem areas (Appendix 2). For instance, 
contrary to expectations the surveys have shown 
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that the main reasons for failure result from the fact 
that the required publications have already been 
borrowed by other users. This finding has lead to a 
number of actions to improve the situation. More 
money was initially made available for duplication 
of recommended titles. When, after a serious reduc- 
tion in the book budget the performance showed a 
strong decline, an increase in the funding was 
obtained as a result of the data we could provide. 
Unfortunately, the present economic conditions 
have resulted in further unavoidable cut-backs. This 
has forced the library to look for other alternatives 
to maintain its performance. Shorter loan periods 
are, unfortunately, difficult to apply in the distance 
teaching mode, due to long periods required for 
postal despatch. The only other way open to us to 
ensure that requested material is available was to 
change the policy for recommended literature. After 
negotiations with the teaching staff it was decided to 
replace recommended books for first-year courses 
with so-called books of readings, containing the 
appropriate chapters of books and required journal 
articles, as a more cost-effective alternative. When 
even that was not sufficient, it was reluctantly 
agreed to further limit the number of titles that 
could be recommended per course. 

The surveys also indicated that a large number of 
failures are due to the inability of the user to obtain 
the required material which was in fact available on 
the shelf. This lead to the addition of the goal that 
user education should be provided and a new post 
was approved for this purpose at a time when all 
other requests were turned down. 

The library is now pursuing an active programme 
to educate its students in the use of library and 
information sources designed to reduce the percent- 
age of availability failures due to users’ inability to 
locate them. Amongst others, workbooks have been 
produced for first- and second-year students 
explaining the use of the library and general refer- 
ence sources. For honours students similar guides 
have been produced on the subject reference 
sources for the various subject areas taught at the 
university. 

So far the effect of this programme on the reduc- 
tion of the failure rate has been rather small and fur- 
ther measures have to be taken. The fact that we 
have already identified and quantified this problem 
area is regarded as important. 

Other problems were identified and addressed in 
a similar manner. Performance measurement does, 
therefore, not only provide an indication of how 
good or bad the library is doing in relation to its 
oals and objectives, but also highlights problem 
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areas which can then be addressed. This is true not 
only in respect of availability, but also in other 
areas. 

Interlending 

T he most dramatic improvements were for 
instance realised in interlending. Although 
immediate availability is the ideal, interlending 
offers a way to improve availability over time. With 
the goal of maximum availability in the shortest 
possible time, the Interlending Section of the Unisa 
Library has developed a number of performance 
measures to determine its effectiveness. The perfor- 
mance measures were instrumental in targeting 
problem areas which could contribute to a more 
effective service by technological and other means. 
Since about 14,000 publications are at present 
requested annually from other libraries, the effec- 
tiveness of this service is a major factor impacting 
on the overall effectiveness of the library. 

Two of the most important dimensions of an 
effective interlending service are: 

- the extent to which required publications can be 
obtained 

- the time it takes to obtain those publications 

Initially, the aim was to provide 90% of these publi- 
cations within two weeks. The actual situation, 
however, indicated that this was totally unrealistic, 
as indicated by the early measurements taken in 
1987 where a reasonable 86.3% of requested publi- 
cations could be provided, but the average delivery 
time was 26.3 days. The advantage was, however, 
that the performance measures were refined, appro- 
priate areas for improvement were identified and 
action plans developed to gradually increase the 
effectiveness of this service. 

Various actions taken have already been docu- 
mented (Willemse). Apart from the general measure 
used for reporting the library’s improved perfor- 
mance in this area, more detailed figures available 
show that a substantial number of publications are 
now supplied within a week (Appendix 3). 

Divisional Performance 

W hen the library’s corporate goals and objec- 
tives with their measures were in place, each 
division had to formulate its own goals and objec- 
tives. The latter had to be supportive of the library’s 
overall goals. The following is a summary of goals 
that were developed over time together with their 
objectives and measures. The Acquisitions 
Division’s goal was simply to obtain the sources 
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identified for addition to the collections. Its objec- 
tives were to do this (i) at the lowest cost; (ii) as 
quickly as possible; (iii) to the largest extent possi- 
ble; and (iv) without unnecessary duplication. The 
measure in respect of the acquisition at the lowest 
cost was rather problematic as a norm to which we 
could compare ourselves was not available. A solu- 
tion was found in comparing our costs to some of 
those of other large university libraries in our region 
on the basis of the data that is supplied to the 
Department of National Education. 

In respect of cataloguing, the objectives were to 
do this timely and in order to achieve maximum 
retrievability. A measure for the latter was used 
whilst the card catalogue was still in use. When the 
library switched to a fully computerised catalogue 
no substitute methodology could be found to mea- 
sure the effectiveness for this aspect of the service. 
For document access the goal was effective circula- 
tion control. The major contribution of this activity 
was to assure that borrowed materials are returned 
in time. The percentage of users who return their 
books before an account is rendered serves as a 
measure of this division’s effectiveness. The objec- 
tive was to minimise the number of accounts sent 
out to students. A further objective set was to min- 
imise the number of books that had to be written off 
or replaced due to loss. The Study Collection’s goal 
was the maximum availability of recommended lit- 
erature when requested as well as the fastest possi- 
ble despatch of books requested by students by post 
or electronically. Subject Librarians were set the 
objective of providing researchers with the maxi- 
mum number of information sources in the library 
that they needed. Also requests for information 
should be answered as correctly and timely as possi- 
ble. 

These goals, objectives and measures were all 
agreed upon by the Chief Director, division heads 
and other senior staff in each subdivision. Although 
they may vary to a large extent from those used 
elsewhere or described in the literature, this is of no 
great concern to us. It is, however, regarded as 
absolutely essential that all persons involved, eg. the 
head and the persons reporting to him, should be in 
complete agreement as to what should be the goals 
and objectives of their section or subdivisions. 

Apart from the effectiveness measures mentioned 
above each division was also required to provide 
one measure of efficiency. 



Advantages 

T he biggest advantage of the system lies in the 
annual and more recently six -monthly planning 
cycle. These regular sessions which the Chief 
Director holds with the divisional heads and other 
senior staff in each division, compel the staff to reg- 
ularly consider what their role in the library is and 
the way in which they support the university’s pro- 
grammes. In particular it forces the staff to focus on 
their most important key performance areas. As 
the system was developed gradually, it has resulted 
in general agreement on all the objectives. 

Invariably new insights into old problems emerge as 
a result of the performance measurement which has 
gradually been done on a more sophisticated basis 
and which is adapted to collect information on par- 
ticular problem areas. This has resulted in a number 
of problem areas which could be reduced or even 
disregarded. 

Disadvantages 

T he biggest disadvantage of performance mea- 
surement is that it tends to be rather time con- 
suming, particularly as staff would like their figures 
to be absolutely correct. The use of small samples 
which can provide an acceptable indication of effec- 
tiveness needs to be accepted. The performance 
measurement and planning system has greatly 
helped to focus on the core business of the library. 
This has, however, also had a very negative result in 
that it over emphasises operational goals. This 
might not have been a problem if proper attention 
had also been given to strategic planning, but for a 
long time nothing was done about this. When the 
library eventually undertook its first strategic plan- 
ning exercise at the beginning of the 90s, which also 
produced a more client orientated mission state- 
ment, a number of very important strategic areas 
were identified ie. finances, affirmative action, rapid 
social change, democratisation, student demands 
and access to services and end-user requirements. 

New Performance Review and 
Planning Approach 

W ith the implementation of the strategic plan, 
which coincided with a restructuring exercise 
in the library, it was obvious that a completely new 
planning and reporting system was necessary. The 
five operational divisions were reduced to three, 
namely Technical Services, Document Delivery and 
Client Services. Two new staff divisions were estab- 
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lished, namely Client and Personnel Development 
and Management Support Services. The latter two 
were to address some of the concerns which were 
highlighted in the strategic planning exercise. 
Corporate workgroups with representatives from all 
the divisions were also given the responsibility for 
other strategic issues. As most of the issues had a 
bearing on the majority of the divisions, they were 
integrated with the operational planning. 

Responsibility for the planning of strategic issues 
was given to the heads of divisions whilst the opera- 
tional planning was done by the 14 subdivision 
heads. The guidelines for the new performance 
review and planning system implemented at the 
beginning of 1995 summarises the process as fol- 
lows: 

‘Performance review and planning: 

- focuses attention on the core business of a subdi- 
vision, its reason for existence, by identifying 
three to five Key Performance Areas, as the most 
important areas of functioning. KPAs are the 
important central functions of the subdivision. 

- identifies the key output services and products 
(called products for convenience) of subdivi- 
sions. Products are the key outputs of the subdi- 
vision that are important for the clients, and 
whose performance is of importance to the over- 
all effectiveness of the library. Hence the Chief 
Director is interested in performance measures 
relating to these products, how they perform, 
because they contribute to the overall success of 
the library 

- identifies for each product one or more suitable 
performance measure that will enable opera- 
tional managers and the Chief Director to assess 
how well the product is performing. Measures 
should be simple, easy to calculate, few, and rel- 
evant. A measure should identify what is most 
important to know about a product - its quality, 
throughput rate, delivery speed to client, or 
whatever is significant and useful to know about 
it. One or two measures per product is ideal. 

- focuses the managerial process from Chief 
Director to line manager on o perational perfor- 
mance and accountability for performance. 

- becomes the centre of management control in a 
library that has become large and diverse in its 
operations, and difficult to co-ordinate and con- 
trol. 

- integrates cost control with output management . ’ 

O 




The term performance measure is used in the fol- 
lowing context: ‘Performance measures tell us how 
well a task is being done. Each product is supposed 
to do something specific, eg. information provision 
is supposed to provide a client with timely, accurate 
and relevant information. If these are the things that 
we should be measuring (this is a hypothetical 
example) then the performance measures would be 
timeliness, accuracy and relevance. 

Performance measures and their targets are usual- 
ly expressed as a ratio, eg. successful service trans- 
actions per user, or as a percentage, eg. percentage 
of items supplied within four working days. Raw 
output statistics do not constitute performance mea- 
sures until they are related to a standard or target. 

Each product should have some way for us to 
measure a relevant characteristic(s) which will 
enable us to say how successful the process is. We 
sometimes have to experiment with different mea- 
sures of product quality and/or client satisfaction to 
discover which are the most indicative, meaningful 
and appropriate measures. 

It is easy to go overboard with measures, to 
attempt to describe fully all the desirable qualities 
of the product. What is needed, however, is a mea- 
sure that is 

- operationally significant and tells the managers 
and staff, and the Chief Director, how well the 
product is performing 

- simple - easy to use and understand. 

- meaningful - really tells us how the product is 
performing 

- does not trv to measure the immeasurable eg. 
project work. Such work is reviewed by 
achievements rather than by measures.’ 

The results have been most encouraging and the 
planning documents which are revised on a six- 
monthly basis by the senior staff in each subdivision 
together with the division manager, are also briefly 
reported on a monthly basis, highlighting critical 
areas. 

Examples of some of the revised strategic and 
operational documents are attached in Appendix 4 
and a list of recently revised performance measures 
is supplied in Appendix 5. 

Conclusion 

P erformance measurement at Unisa is integrated 
in its planning and review procedures. It has 
been developed over more than a decade and is con- 
tinuously adapted and improved. The results of the 

a 



John Willemse: The Impact of Performance Measurement 



measurements provide new facts on many aspects of 
the library’s service. These often confirm long-held 
beliefs, but also result in new insights. 

As a result performance measurement has proved 
its value in the planning process and has greatly 
assisted in improving the library service and in 
maintaining service levels. The time and resources 
devoted to it are, therefore, regarded as an essential 
investment. 
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Appendix 1 




Providing information *nd 
information sources to maat tha 
information need* for study, 
teaching (particularly distance 
teaching) and research programmes 



GOALS 



Information Provision 



Document Delivery 



(Study Collection) 



Document Delivery. 



(Research Collection) 



Promoting the effective use of 
library services and information 
resources 



o 

ERIC 



To assist researchers, 
lecturers and post 
graduate students in the 
identification of and 
access to information 



To assist students 
registered for structured 
courses by the timely 
provision of the necessary 
recommended literature 



Making the various resources of 
the Department of Library Services 
available to the wider community, 
where necessary and at the same 
time being able to use the 
resources of other libraries 



To support present and 
future research and 
teaching by the selective 
acquisition, cataloguing 
and storage of information 
resources required for this 
purpose, and to make thesi 
available 



_ To co-operate with other 
libraries in the collection 
and provision of 
information resources in 
the national interest and 
also for its own benefit 



To make the libraries 
resources available to 
research communities 
other than the University, 
or those with which the 
-library has reciprocal user 
agreements, selectively 
and on a cost-recovery 
basis 



-To familiarise students, 
ecturers and researchers of 
he University with the use 
>f the library and of library 
^sources 



OBJECTIVES 



To answer, upon request, the 
greatest possible percentage 
of bibliographic and 
information enquiries 
accurately and quickly 



The maximum quantity of 
recommended literature 
must be available and 
retrievable 



The maximum quantity of 
information resources for 
research and teaching 
activitiesmust, upon 
request, be available and 
retrievable 



information resources 
which are not availlable 
upon request will be 
supplied, where feasible, 
as fast as possible 




The ability of students, 
lecturers and researchers 
to use the library 
independently and to 
maximally utilise its 
resources must be 
developed 




GLOBAL STANDARDS ACHIEVEMENTS 



BEST COPY AVAILABLE 



Not yet developed 



Not yet developed 



% Resources successfully 
found by clients. Determine 
by surveys from 1989 only 
quaterly 



% Success 

1987- 78,78% 

1988- 81,67% 

1989- 81,07% 

1990- 78,7% 
1991 -82,1% 

1992- 82,2% 

1993- 85,3% 

1994 - 87 , 1 % 



% Availablility of sources: 
monographs in Study Collection. 
Determine through surveys in 2nd 
& 3rd quaters of 1988 



% Avail ability of resources 
in periodicals section 



% Success 

1988 -79,5% 

1989 -85,5% 

1990 -86,2% 

1991 -84,1% 

1992 -85,1% 

1993 -88,3% 

1994 -89,0% 



% Success 

1990 -82.5% 

1991 -79,7% 

1992 -87,8% 

1993- 84,9% 

1994- 81,8% 



Percentage and 
timeliness, measured on 
grounds of average of ILL 
numbers 





% 


Days 


1988 -63,8% 


21 


1989 -60,0% 


21 


1990 -71,2% 


21 


1991 -73,9% 


21 


1992 -76,9% 


21 


1993 -75,8% 


21 


1994 -80.5% 


21 




Not yet developed 



Not yet developed 



Not yet developed 





To manage the library in a 




To achieve the highest 




cost-effective way 




possible number of issues 








per staff member 



Productivity: 
Approved Posts: 276 
Issues 1993: 883 980 

Approved Posts: 281 
Issues 1994: 807 745 



1985 


2 577 


1986 


3 055 


1987 


2 945 


1988 


3 220 


1989 


3 081 


1990 


3 007 


1991 


3153 


1992 


3095 


1993 


3021 


1994 


2 815 
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DOCUMENT DELIVERY DIVISION 

We deliver -fast & friendly 



Appendix 4 includes unpaginated pages 22 to 28 
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OPERATIONAL KPAs & PRODUCTS (Form 3.1) DATE: July 1995 

OPERASIONELE SPAs & PRCDUKTE (Vorm 3.1) DATUM: 




00 
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BEST COPY AVAILABLE 
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Appendix 5 



ULEXIS 



Performance Indicators 



Existing corporate performance measures of the Library 

% client satisfaction with overall service (visiting clients) 

client satisfaction with library collections: satisfaction = <mean of actual 

performance> - <mean of expected performance> 

% availability of information sources (visiting clients): 



productivity: book issues per staff member 

Existing performance measures of subdivisions 
DOCUMENT DELIVERY DIVISION 
Subdivision: Request Services 

% postal book requests supplied within 2 working days 
% client satisfaction with postal book requests service 
% recommended books shelved within 24 hours of return 
% postal periodical requests supplied within 7 working days 
% client satisfaction with postal periodical requests service 
% periodicals shelved within 24 hours after use 
% photocopied documents produced within 2 working days 
% client satisfaction with photocopy service (visiting clients) 

% campus client satisfaction with photocopy facilities and service 

Subdivision: Lending Services 

number of clients in a queue at any given time 
% lending problems solved within 7 working days 
% accounts rendered of total books issued 
% written off as bad debt of total accounts rendered 
% books written off of total books issued 
number of colour reproductions produced per month 

Subdivision: Interlending & Support Services 

average number of days to fill requests from other libraries 
average number of days to notification of unavailability 
% information sources obtained from other libraries within 21 days 
% postal articles distributed within 24 hours of receipt 
% research publications shelved within 24 hours of return 
% research publications incorrectly shelved 
% occupancy of study seats in peak hour 



recommended books 
research publications 
periodicals 



ERIC 
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CLIENT SERVICES DIVISION 

Subdivision: Research Services 

% client satisfaction with archival finding aids 

number of linear metres of archival documents added annually 

% availability of audiovisual items (visiting clients) 

% postal audiovisual item requests supplied within 2 working days 

% client satisfaction with audiovisual service (visual clients) 

% client satisfaction with specific aspects of literature lists (such as relevance) 

% literature search requests filled within 14 days 

index of client satisfaction with accuracy & timeliness of inquiry and advice service 
index of client satisfaction with composition & comprehension: research collection 
index of client satisfaction with composition & comprehension: periodical collection 
% contact with subject librarians by specific client groups 



Subdivision: Study Services 

% availability of recommended books (visiting clients) 

% recommended books on waiting list of total recommended book issues 

% corrections of Tutorial letter 101 returned to lecturers 

dates of last batch orders placed for recommended books 

number of composite readers produced annually 

% client satisfaction with assistance and information provision 

% availability of recommended books at branch libraries (visiting clients) 

% client satisfaction with service at branch libraries 



TECHNICAL SERVICES DIVISION 
Subdivision: Acquisitions 
% Duplicate orders of total book orders 

average number of days between ordering and accessioning of books 
% books acquired of total book orders 
% periodicals obtained before third claim 
% price increases per agent 

numbers of days between accessioning of books and payment of invoices 
% over or under spending of budget 

Subdivision: Descriptive Cataloguing 

% order records processed within 7 days 
number of order records processed per staff member per day 
% bibliographic records completed within 10 days 
% errors in MARC fields referred back 

number of bibliographic records completed per staff member per day 
% errors in final processing of item records 



ERIC 
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Subdivision: Bindery 

% completed binding work of total documents for binding 
% errors in binding work 
% books bound within 30 days 
% periodicals bound within 50 days 
number of documents bound per staff member 

Subdivision: Subject Cataloguing 

% records completed within 40 days 
% express records completed within 1 day 
% hit records completed within 5 days 

% correctness of non-verbal subject catalogue records completed 
% consistency of verbal subject catalogue records completed 
number of LC subject headings assigned per record 
% correctness of authority control 
% completeness of authority control 
% identified database management projects completed 
% items indexed of total items for indexing 
number of indexed records submitted to ISAP 



LIBRARY MANAGEMENT SERVICES DIVISION 

number of hours between reporting a technical computer problem and rectification 
% recurrent problems of total job call-outs 

% problems that can be rectified by self-help skills of total job call-outs 
% client satisfaction with IT support service 



LIBRARY PERSONNEL AND CUENT DEVELOPMENT DIVISION 
none 
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Discussion 

Peter Wynne, University of Central Lancashire: You 
cite 20% cases of failure owing to insufficient infor- 
mation given by users. If users are at a great dis- 
tance, do they establish if the item is available and 
how? 

John Willemse: We are not very happy that we are 
mail order service for students and one of the things 
we are looking at is how they could become library 
users in a fuller sense. Lecturers say they must use 
the library, but all they do is to fill in a card, use a 
teletype service, or if they have it, e-mail. We also 
have a telephone request service on a limited basis. 
These requests are from a list provided by the lec- 
turer for a particular assignment and to ensure that 
they are requested in the right way, each study letter 
of about 1500 courses is checked by my staff before 
it is actually printed to ensure the lecturer does not 
refer to, for example, the author and title of a chap- 
ter in a composite work, which might provide us 
with problems. It’s a way of focusing in on the 
problems and taking action to address them. 

Perhaps I should have stressed more strongly that 
our measures always try to determine the reasons 
for failure so that they can be addressed. We are not 
only concerned with how well we are doing. 

Roswitha Poll, Universitats- und Landesbibliothek 
Munster: Is there any recall from your users? It 
must be very difficult dealing with them at a long 
distance. 

John Willemse: Again, we do it in various ways. We 
do one survey on the postal requests, which of 
course is easy, and we do one at the door for those 
using the library in person. So the postal request is 
on the exact items requested, whether they are avail- 
able immediately or not. At the beginning we start- 
ed by doing just the one survey on the door until we 
discovered that it does not indicate the failures 
because many people may not find what they came 
for but may find other things and tell you that they 
found more than they asked for. So we changed the 
questionnaire and now ask for the number of fail- 
ures, rather than for items positively identified. 

Roswitha Poll: Have you any response from your 
teaching staff on what you are doing? 

John Willemse: We have various surveys. For 
instance of the subject librarians, who serve people 
•n an individual basis. We now do a once-a-year 



survey of a sample of lecturers on their satisfaction 
with the service in general. 

Zamiyah Baba, University of Wales, Aberystwyth: 
You said your target of 90% for recommended liter- 
ature was found to be unrealistic.To what extent are 
the reasons attributable to the library rather than to 
other factors? And what now is a realistic target? 

John Willemse: We feel that we need to address this 
each year and try and do a little better. But how far 
can we go? We feel it doesn’t matter. As in athletics 
- at one stage speed was measured in seconds, then 
in tenths of seconds, and now in hundredths of sec- 
onds. Just trying to do better each year seems to me 
to be the only realistic way to go. I do not know 
how far we can go. It depends on so many external 
factors. If our funding keeps being cut - and it 
needn’t even be cut - with 10% inflation and 
exchange rate changes, it keeps on being reduced in 
real terms. Growth of student numbers is another 
factor that impacts on this issue. 

Marareta Torngren, University of Stockholm: I am 
interested in how your staff were organised to carry 
out this work over the ten years. Did you start with 
some who then taught others? How have you devel- 
oped your staff. How many are involved in this? 

John Willemse: [Very briefly in little time avail- 
able.] We have five Division Heads and 14 Sub- 
Division Heads and they are all are involved. The 
Division Head goes through the process with his 
Sub-Division Heads and discusses it with them and 
with me. 
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